solving system with augumented matrix